Editing a virtual reality space

ABSTRACT

An editing terminal includes a simple display data acquisition unit that acquires simple display data from an item management server, an item selection processing unit that receives selection of an item from a plurality of items displayed using the simple display data, a three-dimensional data acquisition unit that acquires three-dimensional data of a selected item from the item management server, and an editing processing unit that displays an editing space on an editing screen on the basis of editing space information, receives an input of operation information regarding editing of the editing space using the three-dimensional data of the selected item, transmits the operation information to an editing server, and displays the editing space after editing on the editing screen.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of U.S. Patent Application No.17/968,829, filed on Oct. 19, 2022, which claims priority from JapaneseApplication No. 2021-172816, filed on Oct. 22, 2021, the contents ofeach are incorporated by reference herein in its entirety.

BACKGROUND 1. Technical Field

The present disclosure relates to a terminal device, a virtual realityspace editing system, a program, and a virtual reality space editingmethod.

2. Description of the Related Art

The virtual reality technology is a technology for allowing a virtualworld constructed on a computer to be experienced like a real world. Forexample, JP 6556301 B2 describes a virtual reality space in which livecontent corresponding to a video obtained by synthesizing movement of adistributor as movement of a virtual character can be viewed.

SUMMARY

A conventional application for editing a virtual reality space enablesediting with a high degree of freedom by an editor. However, on theother hand, there is a problem that a load required for editing thevirtual reality space is high for the editor or the editing terminal.

The present disclosure solves the above problem, and an object thereofis to obtain a terminal device, a virtual reality space editing system,a program, and a virtual reality space editing method capable ofreducing a load required for editing a virtual reality space.

A terminal device according to the present disclosure includes a simpledisplay data acquisition unit that acquires simple display data from anitem management server that has three-dimensional data and the simpledisplay data of each of a plurality of items usable for editing anediting space that is a virtual reality space for editing and managesthe plurality of items, an item selection processing unit that receivesselection of the items from the plurality of items displayed using thesimple display data on an editing screen displayed for editing theediting space, a three-dimensional data acquisition unit that acquiresthree-dimensional data of the selected item from the item managementserver, and an editing processing unit that displays the editing spaceon the editing screen on the basis of editing space information that isthree-dimensional data of the editing space, receives an input ofoperation information regarding an editing operation of the editingspace using the three-dimensional data of the selected item, transmitsthe operation information to an editing server that manages the editingspace, and displays the editing space after editing on the editingscreen.

A terminal device according to the present disclosure acquires thesimple display data from the item management server, receives selectionof an item from a plurality of items displayed using the simple displaydata on an editing screen displayed for editing the editing space,acquires the three-dimensional data of the selected item from the itemmanagement server, receives input of operation information regardingediting of the editing space using the three-dimensional data of theselected item, transmits the operation information to the editingserver, and displays the editing space after editing on the editingscreen. Thus, while a plurality of selectable items can be displayed, itis not necessary to acquire the three-dimensional data of all of theplurality of items in advance, and thus the terminal device according tothe present disclosure can reduce the load required for editing thevirtual reality space.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of a virtualreality space editing system according to one or more aspects of thedisclosed subject matter;

FIG. 2 is a block diagram illustrating a configuration of an editingterminal according to the one or more aspects of the disclosed subjectmatter;

FIG. 3 is a screen view illustrating an editing screen including athumbnail of an item;

FIG. 4 is a screen view illustrating the editing screen on which an itemis arranged;

FIG. 5 is a schematic diagram illustrating an outline of editing of anediting space using a simply displayed item;

FIG. 6 is a block diagram illustrating a hardware configuration thatachieves a function of a calculation unit included in the editingterminal according to one or more aspects of the disclosed subjectmatter;

FIG. 7 is a flowchart illustrating a virtual reality space editingmethod according to one or more aspects of the disclosed subject matter;

FIG. 8 is a block diagram illustrating a configuration of a modificationexample of the editing terminal according to one or more aspects of thedisclosed subject matter;

FIG. 9 is a screen view illustrating an example of the editing screen;

FIG. 10 is a block diagram illustrating a configuration of a virtualreality space editing system according to one or more aspects of thedisclosed subject matter;

FIG. 11 is a block diagram illustrating a configuration of the editingterminal according to one or more aspects of the disclosed subjectmatter;

FIG. 12 is a flowchart illustrating a virtual reality space editingmethod according to one or more aspects of the disclosed subject matter;

FIG. 13 is a screen diagram illustrating the editing screen incooperative editing;

FIG. 14 is a block diagram illustrating a configuration of amodification example of the editing terminal according to one or moreaspects of the disclosed subject matter;

FIG. 15 is a schematic diagram illustrating an outline of cooperativeediting processing in a case where editing is approved;

FIG. 16 is a block diagram illustrating a configuration of anothermodification example of the editing terminal according to one or moreaspects of the disclosed subject matter;

FIG. 17 is a screen view illustrating the editing screen of an avatarviewpoint in cooperative editing; and

FIG. 18 is a screen view illustrating the editing screen of the editingviewpoint in cooperative editing.

DETAILED DESCRIPTION First Embodiment

FIG. 1 is a block diagram illustrating a configuration of a virtualreality space editing system 1 according to a first embodiment. In FIG.1 , the virtual reality space editing system 1 is a system in which anitem management server 2, an editing server 3, a service providingserver 4, an item providing terminal 5, an editing terminal 6, and aparticipation terminal 7 are connected via a network 8. The network 8can use an existing electric communication line, and is, for example,the Internet. The item providing terminal 5, the editing terminal 6, andthe participation terminal 7 are terminal devices capable ofcommunicating with the item management server 2, the editing server 3,or the service providing server 4 via the network 8. Note that, in thefirst embodiment, although the item management server 2, the editingserver 3, or the service providing server 4 is an independent server,functions of two or more of these servers may be implemented by oneserver, or a function of one of these servers may be implemented by aplurality of servers.

The item providing terminal 5, the editing terminal 6, and theparticipation terminal 7 are, for example, a smartphone, a tabletterminal, or a personal computer (PC). In addition, the editing terminal6 and the participation terminal 7 may be a head mounted display havinga communication function, which is used together with a controller. Forexample, a user wearing the head mounted display on the head and holdingthe controller in the hand can operate the virtual reality spacedisplayed on the head mounted display by moving the head or the hand oroperating a button or the like of the controller. That is, the editingterminal 6 and the participation terminal 7 are only required to bedevices that display the virtual reality space and can operate thevirtual reality space. Note that the user in the first embodimentincludes an editor who is a user who uses the editing terminal 6 to editan editing space to be described later and a participant who is a userwho uses the participation terminal 7 to participate in theparticipation space to be described later.

A virtual reality space is a virtual world constructed on a computer.The virtual reality space in the first embodiment includes a virtualreality space for editing in which only editing by an editor is possibleand a virtual reality space for participation in which a user other thanthe editor can participate. Hereinafter, the virtual reality space forediting is referred to as “editing space”, and the virtual reality spacefor participation is referred to as “participation space”.

The editing server 3 manages the editing space. More specifically, theediting server 3 manages editing space information that isthree-dimensional data of the editing space. Furthermore, the serviceproviding server 4 manages the participation space. More specifically,the service providing server 4 manages participation space informationthat is three-dimensional data of the participation space.

The editing terminal 6 is a first terminal device used by the editor forediting the editing space. The participation terminal 7 is a terminaldevice used for the participant to participate in the participationspace.

The editor may become a participant using the same terminal device asthe editing terminal 6 as the participation terminal 7, and the userother than the editor may become a participant using the participationterminal 7 that is not used as the editing terminal 6. Therefore, theediting terminal 6 and the participation terminal 7 may be either thesame terminal device as or different terminal devices from each other.Further, the user other than the editor can participate in theparticipation space as described above, but the editor can alsoparticipate as a participant.

Details of the editing terminal 6 will be described later.

The item providing terminal 5 is a second terminal device used by anitem provider who provides an item to the item management server 2. Theitem provider uploads the item from the item providing terminal 5 to theitem management server 2 via the network 8. The item uploaded by theitem provider to the item management server 2 is, for example, an itemcreated by the item provider using a three-dimensional modeling tool orthe like. The editor can edit the editing space by downloading a desireditem from the item management server 2 to the editing terminal 6 via thenetwork 8 and arranging the item in the editing space, and the like.

The item provider may become the editor using the same terminal deviceas the item providing terminal 5 as the editing terminal 6, or a userother than the item provider may become the editor using a terminaldevice not used as the item providing terminal 5 as the editing terminal6. Furthermore, the item provider may become the participant using thesame terminal device as the item providing terminal 5 as theparticipation terminal 7, or the user other than the item provider maybecome the participant using the terminal device not used as the itemproviding terminal 5 as the participation terminal 7. Therefore, theitem providing terminal 5 (second terminal device) and the editingterminal 6 (first terminal device) may be either the same terminaldevice or different terminal devices from each other, and the itemproviding terminal 5 and the participation terminal 7 may be either thesame terminal device or different terminal devices from each other. Notethat the user in the first embodiment may also include the itemprovider.

The item management server 2 receives the upload of the item from theitem providing terminal 5 via the network 8 and manages the uploadeditem. Further, the item management server 2 can additionally manage notonly items prepared in advance but also items uploaded from various itemproviders using the item providing terminal 5. Thus, the item managementserver 2 can manage a wide variety of items. The editing server 3 cancreate a diverse virtual reality space by editing the editing spaceusing a wide variety of items managed by the item management server 2.

The item management server 2 has three-dimensional data and simpledisplay data of each of a plurality of items that can be used forediting an editing space that is a virtual reality space for editing,and manages the plurality of items. The item is, for example, a virtualthree-dimensional stationary object or a moving object that can bearranged in the virtual reality space.

The three-dimensional data of the item is data representing the item inthe virtual reality space. The three-dimensional data of the itemincludes, for example, three-dimensional shape information, sizeinformation, color information, and characteristic information of theitem. The characteristic information is characteristic informationindicating a virtual material of the item, and the characteristicinformation includes, for example, a parameter indicating a texture ofthe item and an applied shader, a parameter indicating a sound when theitem collides with another object, or a parameter indicating a physicalcharacteristic. In addition, the three-dimensional data of the item mayinclude, for example, information (hereinafter referred to as “itemspecification information”) specifying the item, such as anitem-specific ID, as the metadata.

The simple display data of the item is data for simply displaying theappearance of the item to an extent that each item can be identified.The simple display data of the item is, for example, two-dimensionaldata indicating the appearance of the item or three-dimensional dataindicating the appearance of the item. Furthermore, the simple displaydata of the item includes the item specification information asmetadata. In addition, the simple display data of the item may include acharacter string indicating the item as metadata in addition to the dataindicating the appearance of the item. The data amount of the simpledisplay data of the item is smaller than the data amount of thethree-dimensional data of the item.

The plurality of items managed by the item management server 2 includesa plurality of items having the same shape as each other and differentcharacteristics indicating colors or virtual materials from each other.For example, the three-dimensional data of the plurality of items havingthe same three-dimensional shape as each other includes colorinformation different from each other or characteristic informationdifferent from each other. The editing server 3 can use a plurality ofitems having different characteristics indicating colors or virtualmaterials from each other even if the shapes are the same as each otherfor editing the editing space, and thus can create a wide variety ofvirtual reality spaces.

The plurality of items managed by the item management server 2 includesa plurality of background items related to different backgrounds fromeach other as items that are three-dimensional data of the background ofthe virtual reality space. The background item is template data forediting a basic background of the virtual reality space. For example,the background item includes an item representing a natural backgroundincluding plants, rivers, and the like, an item representing an indoorbackground including walls, floors, and the like, or an itemrepresenting an urban background including buildings, roads, and thelike. By using the background item in editing the editing space, it ispossible to easily edit the basic background of the editing space.

The background item may include initial background template data forcreating a background of the virtual reality space from scratch. Theinitial background template data is, for example, three-dimensional datarepresenting a ground such as a floor and an empty space with the groundas a boundary. By using the initial background template data for editingthe editing space, it is possible to create a virtual reality space of awide variety of backgrounds according to the sensitivity of the editor.

The items managed by the item management server 2 also include a toolitem which is a tool for space editing. The tool item is an item capableof editing a space by creating an item or the like by a simple operationusing the editing terminal 6, and is, for example, a program moduledescribed in a script language. The space editing operation using thetool item is, for example, an operation using a touch panel mounted on ascreen of the editing terminal 6. By the creation operation of the itemusing the tool item, for example, it is possible to create and arrange ariver item along an arbitrary curve designated in the editing space, abuilding item having a random shape in an arbitrary area designated inthe editing space, or a plurality of items by copying the designateditem in an arbitrary area designated in the editing space. Furthermore,for example, any area designated in the editing space can be filled witha designated color by another space editing operation using the toolitem. The tool item can have a unique three-dimensional shape similarlyto the item of a virtual object, and in this case, the item managementserver 2 also has three-dimensional data and simple display data for thetool item. In editing the editing space, by using the tool item forspace editing, it is possible to perform editing with items other thanthe items managed by the item management server 2 or various types ofediting according to the function of the tool, and thus it is possibleto create a wide variety of virtual reality spaces.

The editing of the editing space is a process of changing editing spaceinformation, which is three-dimensional data of the editing spacemanaged by the editing server 3, by an editing operation in the editingterminal 6. The editing operation includes at least an operation ofselecting one item from a plurality of items displayed by using thesimple display data and arranging the selected item in the editing space(hereinafter, the operation is referred to as a “new arrangementoperation”). In addition, the editing operation may include an operationof selecting an item already arranged in the editing space, moving theitem to another position in the editing space, and rearranging the item(hereinafter referred to as “arrangement changing operation”), anoperation of selecting an item already arranged in the editing space,rearranging the item in another direction in the editing space(hereinafter referred to as “direction changing operation”), anoperation of selecting an item already arranged in the editing space,and deleting the item from the editing space (hereinafter referred to asa “deletion operation”), or the like. In addition, the editing operationmay include an operation of changing the size of the item alreadyarranged in the editing space, an operation of changing the color, anoperation of changing the material (hereinafter, these are collectivelyreferred to as “operation of changing the size or the like”), or thelike. In editing the editing space, upon receiving an input of operationinformation regarding editing using an item, the editing terminal 6transmits the operation information to the editing server 3 via thenetwork 8.

The operation information is information regarding an editing operationof the editing space using the three-dimensional data of the selecteditem. In a case where the editing operation is the new arrangementoperation, the selected item is an item selected from a plurality ofitems displayed using the simple display data. In a case where theediting operation is an operation performed on an item already arrangedin the editing space, such as an arrangement changing operation, adirection changing operation, a deletion operation, or an operation ofchanging the size or the like, the selected item is an item selectedfrom one or a plurality of items already arranged in the editing space.

The operation information includes at least the item specificationinformation for specifying an item selected for the editing operation.In a case where the editing operation is a new arrangement operation, anarrangement changing operation, or a direction changing operation, theoperation information includes, in addition to the item specificationinformation, information indicating the position of the item to bearranged in the editing space after each operation and informationindicating the direction of the item in the editing space. In a casewhere the editing operation is any of operations of changing the sizeand the like, the operation information includes, in addition to theitem specification information, size information indicating a size to beapplied to the item after the changing operation, color informationindicating a color to be applied to the item after the changingoperation, or characteristic information indicating a material to beapplied to the item after the changing operation.

The transmission of the operation information to the editing server isperformed, for example, at a timing when it is determined that eachoperation is ended once. For example, in a case of the arrangementchanging operation, an item already arranged in the editing space can beselected, moved, and rearranged at another position by a drag operation.In this case, it is determined that the editing operation is ended onceat a timing when one drag operation is ended after being started, andthe operation information is transmitted to the editing server 3.Furthermore, for example, in the case of the arrangement changingoperation, it is possible to rearrange the item at another position byinputting a numerical value of each coordinate of the three-dimensionalorthogonal coordinate system indicating the position of the item alreadyarranged in the editing space. In this case, it is determined that theediting operation is ended once at the timing when the numerical valueof each coordinate is input, and the operation information istransmitted to the editing server 3.

Note that, in a case where the item is generated and arranged using thetool item, the editing operation is an operation (hereinafter, it isreferred to as a “generation and arrangement operation”) for generatingand arranging the item using the tool item. The operation information inthis case includes three-dimensional data of the generated item andinformation on the position and the direction of the item in the editingspace.

In a case where a new arrangement operation is performed as the editingoperation, when acquiring operation information from the editingterminal 6, the editing server 3 acquires three-dimensional data of anitem indicated by the operation information from the item managementserver 2 via the network 8. Using the acquired three-dimensional data ofthe item, the editing server 3 edits the editing space information insuch a manner that the item is arranged in the editing space at theposition and the direction indicated by the operation information. Inthis manner, the editing server 3 directly acquires thethree-dimensional data of the item selected in the editing terminal 6from the item management server 2 and edits the editing space. Thus, asdescribed later, the editing terminal 6 acquires the three-dimensionaldata of the selected item from the item management server 2 but does notneed to transmit the three-dimensional data of the selected item to theediting server 3, and it is possible to reduce the load required forediting the editing space in the editing terminal 6.

Furthermore, in a case where an operation such as an arrangementchanging operation, a direction changing operation, or a deletionoperation is performed as the editing operation, the editing server 3already has three-dimensional data of an item that is a target of theediting operation, and upon acquiring the operation information from theediting terminal 6, the editing server 3 can edit the editing spaceinformation on the basis of the three-dimensional data and the operationinformation. Therefore, also in this case, the editing terminal 6 doesnot need to transmit the three-dimensional data of the item to theediting server 3, and the load required for editing the editing space inthe editing terminal 6 can be reduced.

Furthermore, the editing server 3 can also specify a spatial areadisplayed on an editing screen of the editing terminal 6 in the editingspace as a display target area, and transmit three-dimensional data ofthe display target area among the editing space information to theediting terminal 6. The display target area is a spatial area displayedon the editing screen in the editing space. The editor can edit any areaof the editing space. Since the size of the editing screen is limited,the editor normally causes only a partial spatial area of the editingspace, that is, only the display target area to be displayed on theediting screen, and performs the editing operation on the displayeddisplay target area. The editor edits the entire editing space whilechanging the display target area one after another by operating anoperation unit 64 described later, for example. In a case where theeditor performs an operation of changing the display target area, theediting terminal 6 transmits coordinate information of the displaytarget area to be displayed next to the editing server 3, and theediting server 3 specifies the display target area on the basis of thecoordinate information acquired from the editing terminal 6 andtransmits three-dimensional data of the display target area to theediting terminal 6. Furthermore, in a case where the editor performs theediting operation on the display target area, the editing terminal 6transmits the operation information to the editing server 3, and theediting server 3 edits the display target area and transmitsthree-dimensional data of the display target area after editing to theediting terminal 6. As described above, the editing server 3 is onlyrequired to transmit the information including at least thethree-dimensional data of the display target area among the editingspace information to the editing terminal 6, and does not need totransmit the entire editing space information. Thus, the editingterminal 6 does not need to store the entire editing space informationin the storage device (for example, a storage unit 65 to be describedlater) and does not need to process the entire editing spaceinformation, and can reduce the load required for editing the editingspace and the load on the storage device.

The service providing server 4 manages the participation space andprovides a service using the participation space via the network 8. Theuser who uses the service of the participation space can participate inthe participation space via the network 8 using the participationterminal 7. Here, the participation in the participation space includesthat the avatar corresponding to the participant enters theparticipation space in addition to that the participant views theparticipation space.

The virtual reality space editing system 1 is a system used for editingthe editing space, and thus may not include the service providing server4, the item providing terminal 5, and the participation terminal 7illustrated in FIG. 1 . That is, in the virtual reality space editingsystem 1 including the editing terminal 6, the item management server 2,and the editing server 3, the editing server 3 edits the editing spaceusing the three-dimensional data of each of the editing space and theitem, and thus the editing terminal 6 can reduce the load required forediting the editing space.

FIG. 2 is a block diagram illustrating a configuration of the editingterminal 6. As illustrated in FIG. 2 , the editing terminal 6 includes acommunication unit 61, a calculation unit 62, a display unit 63, anoperation unit 64, and a storage unit 65. The communication unit 61 is acommunication interface for communicating with other devices. Thecommunication unit 61 is a communication device capable of mobilecommunication by a communication system such as LTE, 3G, 4G, or 5G, forexample, and communicates with another device (FIG. 2 illustrates onlythe item management server 2 or the editing server 3) such as the itemmanagement server 2 or the editing server 3 connected to the network 8.In addition, the communication unit 61 may include a short-rangewireless communication unit such as Bluetooth (registered trademark).

The calculation unit 62 controls the overall operation of the editingterminal 6. For example, in a case where an editing application isinstalled in the editing terminal 6, the calculation unit 62 achievesvarious functions for editing the editing space by executing the editingapplication. Furthermore, for example, in a case where the editingapplication is executed in the editing server 3, the calculation unit 62achieves various functions for editing the editing space by receiving aninstruction from the editing server 3.

The display unit 63 is a display device included in the editing terminal6. The display unit 63 is, for example, a liquid crystal display (LCD)or an organic electroluminescence (EL) display device. In a case wherethe editing terminal 6 is a head mounted display, a display method ofthe display unit 63 is a non-transmissive type.

The operation unit 64 is an input device that receives an operation onthe editing screen displayed on the display unit 63. In a case where theediting terminal 6 is a smartphone or a tablet terminal, the operationunit 64 is, for example, a touch panel provided integrally with thescreen of the display unit 63. In a case where the editing terminal 6 isa PC, the operation unit 64 is, for example, a mouse or a keyboard. In acase where the editing terminal 6 is a head mounted display, theoperation unit 64 is a head mounted display and a controller usedtogether with the head mounted display.

The storage unit 65 is a storage device that stores an applicationprogram such as an editing application and stores data used forcalculation processing of the calculation unit 62. In the storage unit65, for example, the editing space information received from the editingserver 3 via the network 8 by the communication unit 61 is stored.

The calculation unit 62 includes a simple display data acquisition unit621, an item selection processing unit 622, a three-dimensional dataacquisition unit 623, and an editing processing unit 624. For example,the calculation unit 62 executes the editing application stored in thestorage unit 65, thereby implementing the functions of the simpledisplay data acquisition unit 621, the item selection processing unit622, the three-dimensional data acquisition unit 623, and the editingprocessing unit 624.

The simple display data acquisition unit 621 acquires the simple displaydata of the item from the item management server 2. The simple displaydata of the item is data for simply displaying the appearance of theitem to an extent that each item can be identified, and is generatedcorresponding to each of the plurality of items managed by the itemmanagement server 2. The simple display data of the item is, forexample, two-dimensional data indicating the appearance of the item orthree-dimensional data indicating the appearance of the item, and thedata amount of the simple display data of the item is smaller than thedata amount of the three-dimensional data of the item. Furthermore, thesimple display data of the item includes the item specificationinformation as metadata. In addition, the simple display data of theitem may include a character string indicating the item as metadata inaddition to the data indicating the appearance of the item. The simpledisplay data acquisition unit 621 simply displays the item on thedisplay unit 63 using the simple display data. The simple display usingthe simple display data of the item functions as a thumbnail indicatingeach item to the user in an identifiable manner. In a case where thesimple display data of the item includes a character string, the simpledisplay may include the character string. Furthermore, the simpledisplay data acquisition unit 621 outputs the simple display data to theitem selection processing unit 622.

The simple display data acquisition unit 621 can acquire the simpledisplay data indicating at least a part of the plurality of itemsmanaged by the item management server 2 from the item management server2. In other words, the simple display data acquisition unit 621 mayacquire the simple display data indicating all of the plurality of itemsmanaged by the item management server 2 from the item management server2, or may acquire the simple display data indicating only some of theplurality of items managed by the item management server 2.

For example, the item management server 2 manages category data fordisplaying a category of each of a plurality of items, and manages thesimple display data for each category of items. The simple display dataacquisition unit 621 acquires category data from the item managementserver 2 via the network 8 by the communication unit 61, and displays aplurality of categories on the display unit 63 using the category data.

FIG. 3 is a screen diagram illustrating an editing screen 63A includinga thumbnail 632A of the item 633 (see FIG. 4 ). The thumbnail such asthe thumbnail 632A illustrated in a thumbnail list 632 of FIG. 3 is anexample in a case where the simple display data of the item is thetwo-dimensional data. In FIG. 3 , a category list 631 is displayed onthe editing screen 63A. For example, the editor uses the operation unit64 such as a touch panel to select a category 631A from the categorylist 631 as illustrated in FIG. 3 . The simple display data acquisitionunit 621 acquires the simple display data corresponding to the selectedcategory 631A from the item management server 2 via the network 8 by thecommunication unit 61. The simple display data acquisition unit 621displays the thumbnail list 632 of the plurality of items belonging tothe category 631A on the editing screen 63A by using the simple displaydata corresponding to the category 631A.

As described above, in a case where the simple display data acquisitionunit 621 acquires the simple display data indicating only some of theplurality of items managed by the item management server 2, theprocessing load required for editing the editing space can be reduced ascompared with a case of acquiring the simple display data for all of theplurality of items managed by the item management server 2.

The item selection processing unit 622 receives selection of an itemfrom a plurality of items displayed on the display unit 63 using thesimple display data. For example, the item selection processing unit 622specifies a simple display position of the item selected using theoperation unit 64 from respective simple display positions of theplurality of items on the display unit 63 indicated by the simpledisplay data, thereby receiving the selection of the item. In FIG. 3 ,the editor uses operation unit 64 to select the thumbnail 632A fromthumbnail list 632 displayed on the editing screen 63A. The itemselection processing unit 622 outputs the item specification informationfor specifying the item selected using the operation unit 64 to thethree-dimensional data acquisition unit 623.

The three-dimensional data acquisition unit 623 acquiresthree-dimensional data of the selected item from the item managementserver 2. The three-dimensional data of the item is data representingthe item in the virtual reality space. The three-dimensional data of theitem includes, for example, the three-dimensional shape information, thesize information, the color information, and the characteristicinformation of the item. The three-dimensional data of the items can beused to three-dimensionally display the items in the virtual realityspace and to develop characteristics of the items in the virtual realityspace. The three-dimensional data acquisition unit 623 accesses the itemmanagement server 2 via the network 8 by the communication unit 61,transmits the item specification information for specifying the selecteditem, and acquires three-dimensional data of the item specified by theitem specification information among the plurality of items managed bythe item management server 2. The three-dimensional data acquisitionunit 623 outputs the acquired three-dimensional data of the item to theediting processing unit 624.

Note that each of the plurality of items managed by the item managementserver 2 may be a free item or a pay item (hereinafter, the item isreferred to as a “pay item”). In a case where the item is a pay item,for example, the simple display data included in the item managementserver 2 includes price information of the item as metadata. Then, theediting terminal 6 that has acquired the simple display data of the payitem performs simplified display including the price of the pay item, sothat the editor can check the price of each pay item and then make adecision as to whether or not to purchase and use the pay item.

The editing processing unit 624 displays the editing space on theediting screen of the display unit 63 on the basis of the editing spaceinformation, receives input of operation information for the selecteditem from the operation unit 64, transmits the received operationinformation to the editing server 3, and displays the editing spaceafter editing on the editing screen. The operation information isinformation regarding the editing operation of the editing space usingthe three-dimensional data of the selected item. For example, theoperation information includes the item specification information forspecifying an item selected for the editing operation, a position of anitem arranged in the editing space, and a direction of the item in theediting space.

The editing processing unit 624 acquires the editing space informationedited by the editing server 3 on the basis of the operationinformation, and displays the editing space after editing on the editingscreen on the basis of the acquired editing space information. Forexample, upon receiving the input of the operation information from theoperation unit 64, the editing processing unit 624 transmits theoperation information to the editing server 3. The editing server 3edits the editing space on the basis of the operation informationreceived from the editing terminal 6. Then, the editing processing unit624 displays the editing space after editing on the editing screen onthe basis of the editing space information after editing received fromthe editing server 3. Note that, in a case of receiving the input of theoperation information, the editing processing unit 624 may edit theediting space information stored in the storage unit 65 of the editingterminal 6 on the basis of the operation information, display theediting space after editing once on the editing screen, and then displaythe editing space after editing on the editing screen on the basis ofthe editing space information after editing by the editing server 3received from the editing server 3.

FIG. 4 is a screen view illustrating the editing screen 63A on which theitem 633 is arranged, and illustrates the item 633 corresponding to thethumbnail 632A selected from the thumbnail list 632 of FIG. 3 . Forexample, upon receiving an input of operation information for arrangingthe item 633 in the editing space, the editing processing unit 624transmits the operation information to the editing server 3. The editingserver 3 edits the editing space on the basis of the operationinformation received from the editing terminal 6. The editing processingunit 624 acquires the editing space information edited on the basis ofthe operation information from the editing server 3, and displays theediting space in which the item 633 is arranged on the editing screen63A on the basis of the acquired editing space information. As describedabove, since the editing processing unit 624 acquires the editing spaceinformation after editing from the editing server 3, the editor usingthe editing terminal 6 can check the state of the editing space managedby the editing server 3.

The editing processing unit 624 acquires, from the editing server 3,three-dimensional data of the display target area to be displayed on theediting screen among the editing space information of the editing spacemanaged by the editing server 3 as the editing space information. Forexample, the editing processing unit 624 causes the communication unit61 to transmit the coordinate information of the display target area tobe displayed on the editing screen to the editing server 3 via thenetwork 8. The editing server 3 specifies the display target area on thebasis of the coordinate information acquired from the editing terminal6, and transmits the three-dimensional data of the specified displaytarget area to the editing terminal 6. The editing processing unit 624displays the display target area on the editing screen on the basis ofthe three-dimensional data of the display target area acquired from theediting server 3. The editing server 3 is only required to transmit theinformation including at least the three-dimensional data of the displaytarget area among the editing space information to the editing terminal6, and does not need to transmit the entire editing space information.Since the editing processing unit 624 is only required to acquire theediting space information indicating the display target area instead ofthe entire editing space from the editing server 3, the editing terminal6 does not need to store the entire editing space information in thestorage unit 65 and does not need to process the entire editing spaceinformation, and the load required for editing the editing space in theediting terminal 6 and the load on the storage unit 65 can be reduced.

In addition, the editing processing unit 624 may delete, from thestorage unit 65, three-dimensional data other than the display targetarea currently being displayed on the editing screen. For example, in acase where the display target area is changed by the editor performingan operation of changing a spatial area as an editing target in theediting space using the operation unit 64, or the like, the editingprocessing unit 624 uses the three-dimensional data of the displaytarget area currently being displayed on the editing screen among theediting space information stored in the storage unit 65 to specifythree-dimensional data other than the display target area currentlybeing displayed, and deletes the specified three-dimensional data. Thus,the load on the storage unit 65 required for editing the editing spacecan be reduced.

Although FIG. 3 illustrates an example of the thumbnail in a case wherethe simple display data of the item is the two-dimensional data, asdescribed above, the simple display data of the item used to display thethumbnail may be the three-dimensional data. In this case, the thumbnail(hereinafter referred to as a “three-dimensional thumbnail”) can betreated as a virtual object in the editing space, similarly to the itemof an object. For example, FIG. 5 is a schematic diagram illustrating anoutline of editing of the editing space using the simply displayed item636, and illustrates an outline of an item indicated by athree-dimensional thumbnail and an editing process using the item. Theupper diagram with an outlined arrow being a boundary in FIG. 5 is adiagram illustrating an outline of an item indicated by athree-dimensional thumbnail and selection processing thereof, and thelower diagram with the arrow being the boundary is a diagramillustrating the editing space in which the selected item 636 isarranged.

As illustrated in the upper diagram of FIG. 5 , the simple display dataacquisition unit 621 displays a three-dimensional thumbnail list 634 onthe editing screen of the display unit 63. Unlike the thumbnail selectedby the click operation like the thumbnail displayed using thetwo-dimensional data, the three-dimensional thumbnail is selected bymoving the three-dimensional thumbnail indicating the item that theeditor intends to use from the three-dimensional thumbnail list 634. Anavatar 635 illustrated in FIG. 5 is an avatar arranged in the editingspace and corresponding to the editor, and can be operated by anoperation using the operation unit 64. The avatar 635 moves athree-dimensional thumbnail 632B from the three-dimensional thumbnaillist 634 according to the operation using the operation unit 64. Whenthe three-dimensional thumbnail 632B is moved, the item selectionprocessing unit 622 receives the selection of the item corresponding tothe three-dimensional thumbnail 632B.

The three-dimensional data acquisition unit 623 acquires thethree-dimensional data of the item corresponding to thethree-dimensional thumbnail 632B from the item management server 2, andoutputs the three-dimensional data to the editing processing unit 624.Using the three-dimensional data acquired from the three-dimensionaldata acquisition unit 623, the editing processing unit 624 displays theitem 636 corresponding to the three-dimensional thumbnail 632B on theediting screen as illustrated in the lower diagram of FIG. 5 . By usingthe three-dimensional thumbnail 632B for item selection, it is possibleto give the editor a feeling like actually handling the item in theediting space with the hand.

FIG. 6 is a block diagram illustrating a hardware configuration thatimplements the function of the calculation unit 62 included in theediting terminal 6. The function of the editing terminal 6 is achievedby the calculation unit 62. The calculation unit 62 has a communicationinterface 100, an input-output interface 101, a processor 102, and amemory 103. The functions of the simple display data acquisition unit621, the item selection processing unit 622, the three-dimensional dataacquisition unit 623, and the editing processing unit 624 included inthe calculation unit 62 are achieved by these hardware configurations.

The communication interface 100 transmits the editing space informationreceived by the communication unit 61 from the editing server 3 via thenetwork 8 to the processor 102, and transmits the operation informationreceived by the operation unit 64 to the editing server 3 via thenetwork 8. Furthermore, the processor 102 controls display on thedisplay unit 63 via the input-output interface 101, acquires operationinformation from the operation unit 64, and controls reading and writingof data from and to the storage unit 65.

An application program for achieving respective functions of the simpledisplay data acquisition unit 621, the item selection processing unit622, the three-dimensional data acquisition unit 623, and the editingprocessing unit 624 is stored in the storage unit 65. The storage unit65 is, for example, a semiconductor memory mounted on a smartphone. Theprocessor 102 reads the application program stored in the storage unit65 via the input-output interface 101, loads the application programinto the memory 103, and executes the loaded program. Thus, theprocessor 102 implements the respective functions of the simple displaydata acquisition unit 621, the item selection processing unit 622, thethree-dimensional data acquisition unit 623, and the editing processingunit 624. The memory 103 is, for example, a random access memory (RAM).

FIG. 7 is a flowchart illustrating a virtual reality space editingmethod according to the first embodiment, and illustrates editingprocessing of the editing space by the editing terminal 6.

First, the simple display data acquisition unit 621 acquires the simpledisplay data from the item management server 2 via the network 8 by thecommunication unit 61 (step ST1).

The item selection processing unit 622 receives selection of an itemfrom a plurality of items displayed using the simple display data (stepST2).

The three-dimensional data acquisition unit 623 acquires thethree-dimensional data of the item selected by the item selectionprocessing unit 622 from the item management server 2 via the network 8by the communication unit 61 (step ST3).

The editing processing unit 624 displays the editing screen on the basisof the editing space information, and receives an input of the operationinformation of the item selected by the item selection processing unit622 from the operation unit 64. Upon receiving the operationinformation, the editing processing unit 624 causes the communicationunit 61 to transmit the received operation information to the editingserver 3 via the network 8, and displays the editing space after editingon the editing screen (step ST4).

As described above, the editing terminal 6 of the first embodimentacquires the simple display data from the item management server 2,receives selection of an item from a plurality of items displayed on theediting screen using the simple display data, acquires thethree-dimensional data of the selected item from the item managementserver 2, receives input of operation information regarding editing ofthe editing space using the three-dimensional data of the selected item,transmits the operation information to the editing server 3, anddisplays the editing space after editing on the editing screen. Thus,while a plurality of selectable items can be displayed, it is notnecessary to acquire the three-dimensional data of all of the pluralityof items in advance, and thus the editing terminal 6 can reduce the loadrequired for editing the virtual reality space.

Note that, in the example of the embodiments so far, in a case ofreceiving the selection of the item from the plurality of itemsdisplayed on the editing screen, the editing terminal 6 acquires thethree-dimensional data of the item selected from the item managementserver 2 for the first time, but for example, the three-dimensional datamay be acquired at a similar timing to the acquisition of the simpledisplay data for some items that are generally frequently used among theplurality of items managed by the item management server 2. Also in thiscase, while a plurality of selectable items can be displayed, it is notnecessary to acquire the three-dimensional data of all of the pluralityof items in advance, and thus the editing terminal 6 can reduce the loadrequired for editing the virtual reality space.

Hereinafter, a modification example of the first embodiment will bedescribed.

FIG. 8 is a block diagram illustrating a configuration of an editingterminal 6A which is a modification example of the editing terminal 6.In FIG. 8 , the editing terminal 6A includes the communication unit 61,a calculation unit 62A, the display unit 63, the operation unit 64, andthe storage unit 65. The calculation unit 62A controls the overalloperation of the editing terminal 6A. Furthermore, the calculation unit62A executes the editing application installed in the editing terminal6A to implement functions of the simple display data acquisition unit621, the item selection processing unit 622, the three-dimensional dataacquisition unit 623, an editing processing unit 624A, a correctioninstruction transmission unit 625, and a transmission instruction unit626.

The correction instruction transmission unit 625 transmits a correctioninstruction to correct the participation space information on the basisof the editing space information to the editing server 3 via the network8 by the communication unit 61. The participation space is a virtualreality space in which users other than the editor can participate. Theeditor can also participate in the participation space as a participant.The participation space information is information includingthree-dimensional data of the participation space and three-dimensionaldata of items arranged in the participation space. The three-dimensionaldata of the item arranged in the participation space includes thethree-dimensional shape information, the size information, the colorinformation, and the characteristic information of the item. Also in themodification example of the first embodiment, the participation space ismanaged by the service providing server 4. More specifically, theservice providing server 4 manages participation space information thatis three-dimensional data of the participation space.

The correction of the participation space information means that, afterthe editing space information is edited on the basis of one or aplurality of pieces of editing information, a change to theparticipation space is performed on the basis of the editing spaceinformation including editing content. The editing content is content ofediting indicated by each piece of operation information or contentobtained by integrating content of editing indicated by each of aplurality of pieces of operation information. By including thecorrection instruction transmission unit 625, the editing terminal 6Acan correct the participation space according to the editing content ofthe editing space information at the timing of transmitting thecorrection instruction. In the modification example of the firstembodiment, upon receiving the correction instruction from the editingterminal 6A, the editing server 3 transmits the editing spaceinformation managed by the editing server 3 to the service providingserver 4. Upon receiving the editing space information from the editingserver 3, the service providing server 4 replaces the received editingspace information with the participation space information that has beenmanaged by the service providing server 4 so far as new participationspace information. In this way, the participation space information iscorrected.

The editing server 3 may store a history of the editing content which isa difference between the participation space information managed by theservice providing server 4 and the editing space information managed bythe editing server 3 before the correction. The history of the editingcontent indicates editing content that has not been used for correctionof the participation space information. In this case, by transmittingthe history of the stored editing content to the service providingserver 4 after receiving the correction instruction, the serviceproviding server 4 can correct the participation space information onthe basis of the received history of the editing content.

The editing server 3 has, for example, the editing space information inan initial state that is three-dimensional data of the editing space inan initial state in which no item is arranged, and transmits the editingspace information in the initial state to the editing terminal 6A on thebasis of a request from the editing terminal 6A, and the editingterminal 6A displays an editing screen indicating the editing space onthe display unit 63 on the basis of the received editing spaceinformation in the initial state. Thereafter, the editor edits theediting space information in the initial state using the editingterminal 6A. In a case where desired editing is completed, the editorperforms an operation for setting (releasing) the editing space so as toallow the user other than the editor to participate in the editingspace, and thereby information obtained by copying the editing spaceinformation managed by the editing server 3 is transmitted to theservice providing server 4 as the participation space information. Whenthe participation space information is transmitted to the serviceproviding server 4, the participation space indicated by theparticipation space information is in a state of being managed by theservice providing server 4 for the first time. As described above, whenthe editing space is released as the participation space, the editingserver 3 has the editing space information having the same content asthe participation space information of the participation space managedby the service providing server 4. However, there is a case where theeditor further edits the editing space using the editing terminal 6Aafter the release, and in this case, the participation space informationmanaged by the service providing server 4 and the editing spaceinformation managed by the editing server 3 have different content.

Even in such a case, by including the correction instructiontransmission unit 625, the editing terminal 6A can correct theparticipation space according to the editing content of the editingspace information at the timing of transmitting the correctioninstruction.

For example, upon transmitting the operation information from theediting terminal 6A to the editing server 3, the correction instructiontransmission unit 625 transmits a correction instruction for instructingcorrection according to the operation information to the editing server3. The editing server 3 edits the editing space information according tothe operation information, and transmits the editing space informationincluding the editing content to the service providing server 4, therebycorrecting the participation space information. Thus, the editingterminal 6A can correct the participation space based on the editingcontent of the editing space every time the editing operation isperformed. Note that, in this case, the transmission instruction unit626 is unnecessary.

In a case where the calculation unit 62A has the transmissioninstruction unit 626, the transmission instruction unit 626 receives atransmission instruction to transmit the correction instruction to theediting server 3. For example, the editing processing unit 624A displaysa transmission instruction button for transmitting the correctioninstruction to the editing server 3 by an operation of the editor on theediting screen, and the transmission instruction unit 626 receives anoperation of the transmission instruction button using the operationunit 64. When the transmission instruction unit 626 receives theoperation of the transmission instruction button, the correctioninstruction transmission unit 625 transmits the correction instructionto the editing server 3. Thus, the editing terminal 6A can performcorrection of the participation space based on the editing content ofthe editing space information at a timing intended by the editor.

The editing processing unit 624A can display the editing space on thebasis of the editing space information, and can display theparticipation space on the basis of the participation space information.For example, the editing processing unit 624A displays the editingscreen on the display unit 63 using the editing space information, anddisplays the screen of the participation space on the display unit 63using the participation space information. The editing terminal 6A canacquire the participation space information from the service providingserver 4. Furthermore, the editing processing unit 624A can switch anddisplay the editing space and the participation space on the displayunit 63. Thus, the editor can visually recognize the editing space asthe editing target and the participation space corresponding thereto onthe display unit 63.

Furthermore, the editing processing unit 624A can display the editingcontent already used for correction of the participation space and theediting content not yet used for correction of the participation spacein the editing space on the editing screen in a distinguished manner.FIG. 9 is a screen diagram illustrating an example of the editing screen63A. In the editing screen 63A illustrated in FIG. 9 , an editing area636A corresponds to editing content not yet used for correction of theparticipation space, and an editing area 636B other than the editingarea 636A corresponds to the editing content already used for correctionof the participation space.

As described above, the editing server 3 may store the history of theediting content which is the difference between the participation spaceinformation managed by the service providing server 4 before correctionand the editing space information managed by the editing server 3. Thehistory of the editing content indicates editing content that has notbeen used for correction of the participation space information. Forexample, by using the history of the editing content, the editingprocessing unit 624A determines the editing content not used forcorrection of the participation space information among the editingcontent of the editing space information, and displays the editing area636A corresponding to the determined editing content in a distinguishedmanner from the editing area 636B corresponding to the editing contentalready used for correction of the participation space information.Examples of a method of distinguishing display include displaying theediting area 636A in a color different from the editing area 636B,displaying the editing area 636A in a blinking manner, or displaying aframe line along the outer shape of the editing area 636A. The editorwho has visually recognized the editing screen 63A can easily grasp theediting content already used for correction of the participation spaceand the editing content not yet used for correction of the participationspace.

As described above, the editing terminal 6 according to the firstembodiment includes the simple display data acquisition unit 621 thatacquires the simple display data from the item management server 2, theitem selection processing unit 622 that receives selection of an itemfrom the plurality of items displayed using the simple display data, thethree-dimensional data acquisition unit 623 that acquiresthree-dimensional data of the selected item from the item managementserver 2, and the editing processing unit 624 that displays the editingspace on the editing screen on the basis of the editing spaceinformation, receives an input of operation information regarding anediting operation of the editing space using the three-dimensional dataof the selected item, transmits the operation information to the editingserver 3 that manages the editing space, and displays the editing spaceafter editing on the editing screen 63A. The editing server 3 edits theediting space using the item selected in the editing terminal 6, and theediting terminal 6 displays the editing space after editing on theediting screen. While a plurality of selectable items can be displayed,it is not necessary to acquire the three-dimensional data of all of theplurality of items in advance, and thus the editing terminal 6 canreduce the load required for editing the virtual reality space.

In the editing terminal 6 according to the first embodiment, the simpledisplay data acquisition unit 621 acquires the simple display dataindicating at least a part of the plurality of items from the itemmanagement server 2. Thus, the simple display data acquisition unit 621is only required to acquire the simple display data indicating at leasta part of the plurality of items managed by the item management server2, and thus it is possible to reduce the load required for editing theediting space.

In the editing terminal 6 according to the first embodiment, theoperation information is information including the item specificationinformation for specifying the selected item, the position of the itemarranged in the editing space, and the direction of the item in theediting space. The editing processing unit 624 acquires the editingspace information edited by the editing server 3 on the basis of theoperation information, and displays the editing space after editing onthe editing screen 63A on the basis of the editing space information.Thus, the editor using the editing terminal 6 can check the state of theediting space managed by the editing server 3.

In the editing terminal 6 according to the first embodiment, the editingprocessing unit 624 acquires, from the editing server 3,three-dimensional data of the display target area displayed on theediting screen 63A among the editing space information of the editingspace managed by the editing server 3 as the editing space information.Since the editing processing unit 624 is only required to acquire theediting space information indicating the display target area instead ofthe entire editing space information from the editing server 3, theediting terminal 6 does not need to store the entire editing spaceinformation in the storage device and does not need to process theentire editing space information, and the load required for editing theediting space in the editing terminal 6 and the load on the storage unit65 can be reduced.

The editing terminal 6 according to the first embodiment includes thestorage unit 65 used for editing the editing space. The editingprocessing unit 624 deletes the three-dimensional data other than thedisplay target area currently being displayed on the editing screen 65Afrom the storage unit 65. Thus, the load on the storage unit 65 requiredfor editing the editing space can be reduced.

In the editing terminal 6 according to the first embodiment, theplurality of items includes a plurality of items having the same shapeas each other and different characteristics indicating colors or virtualmaterials from each other. Since a plurality of items having differentcharacteristics from each other can be used for editing the editingspace even if their shapes are the same as each other, a wide variety ofvirtual reality spaces can be created. Furthermore, by making the itemsto be a wide variety of items, the necessity of making the editingapplication for the virtual reality space multifunctional to enableediting with a high degree of freedom by the editor is reduced, and thusit is possible to reduce the load on the editing terminal 6.

In the editing terminal 6 according to the first embodiment, theplurality of items includes a plurality of background items related todifferent backgrounds from each other as items that arethree-dimensional data of the background of the virtual reality space.By using such a plurality of background items, a wide variety of virtualreality spaces can be created. Furthermore, the editing space can beeasily edited by using the background item. Furthermore, by making thebackground item available, the necessity of making the editingapplication for the virtual reality space multifunctional to enableediting with a high degree of freedom by the editor is reduced, and thusit is possible to reduce the load on the editing terminal 6.

In the editing terminal 6 according to the first embodiment, theplurality of items includes a tool item that is a tool for spaceediting. Since it is possible to perform editing of the space such ascreating an item other than the existing item in the item managementserver 2 using the tool item for space editing, it is possible to createa wide variety of virtual reality spaces. Furthermore, by making thetool item available, the necessity of making the editing application forthe virtual reality space multifunctional to enable editing with a highdegree of freedom by the editor is reduced, and thus it is possible toreduce the load on the editing terminal 6.

The editing terminal 6A according to the first embodiment includes thecorrection instruction transmission unit 625 that transmits, to theediting server 3, a correction instruction for correcting, on the basisof the editing space information, the participation space informationthat is three-dimensional data of the participation space that is thevirtual reality space in which the user other than the editor is allowedto participate. Thus, the participation space can be corrected on thebasis of the editing content of the editing space information at thetiming when the correction instruction is transmitted.

In the editing terminal 6A according to the first embodiment, when theediting processing unit 624 transmits the operation information to theediting server 3, the correction instruction transmission unit 625transmits the correction instruction to the editing server 3. Thus, theediting terminal 6A can correct the participation space based on theediting content of the editing space information each time the editingoperation is performed.

The editing terminal 6A according to the first embodiment includes thetransmission instruction unit 626 that receives a transmissioninstruction to transmit a correction instruction to the editing server3, and the correction instruction transmission unit 625 transmits thecorrection instruction to the editing server 3 when the transmissioninstruction unit 626 receives the transmission instruction. Thus, theediting terminal 6A can perform correction of the participation spacebased on the editing content of the editing space information at atiming intended by the editor.

In the editing terminal 6A according to the first embodiment, theediting processing unit 624 can display the editing space on the basisof the editing space information, and can display the participationspace on the basis of the participation space information that isthree-dimensional data of the participation space that is the virtualreality space in which the user other than the editor is allowed toparticipate. Thus, the editor can visually recognize the editing spaceas the editing target and the participation space corresponding theretoon the display unit 63.

In the editing terminal 6A according to the first embodiment, theediting processing unit 624 can switch and display the editing space andthe participation space. Thus, the editor can visually recognize theediting space as the editing target and the participation spacecorresponding thereto on the display unit 63.

In the editing terminal 6A according to the first embodiment, theediting processing unit 624 displays the editing content already usedfor correction of the participation space and the editing content notyet used for correction of the participation space in the editing spacein a distinguished manner. Thus, the editor who has viewed the editingscreen can easily grasp the editing content already used for correctionof the participation space and the editing content not yet used forcorrection of the participation space.

The virtual reality space editing system 1 according to the firstembodiment includes the editing terminal 6 or 6A, the item managementserver 2, and the editing server 3. While a plurality of selectableitems can be displayed, it is not necessary to acquire thethree-dimensional data of all of the plurality of items in advance, andthus the editing terminal 6 or 6A can reduce the load required forediting the virtual reality space.

In the virtual reality space editing system 1 according to the firstembodiment, the item management server 2 receives upload of the itemfrom the item providing terminal 5 that is the same as or different fromthe editing terminal 6 or 6A, and manages the item received for upload.Thus, since a wide variety of items is uploaded to the item managementserver 2, it is possible to give diversity to the participation space byediting the editing space using a wide variety of items. Furthermore, byenabling addition of a wide variety of items, the necessity of makingthe editing application for the virtual reality space multifunctional toenable editing with a high degree of freedom by the editor is reduced,so that the load on the editing terminal 6 can be reduced.

In the virtual reality space editing system 1 according to the firstembodiment, upon acquiring the operation information from the editingterminal 6 or 6A, the editing server 3 acquires the three-dimensionaldata of the item indicated by the operation information from the itemmanagement server 2, and edits the editing space information included inthe editing server 3 in such a manner that the item is arranged in theediting space at the position and the direction indicated by theoperation information. Thus, the editing terminal 6 does not need totransmit the three-dimensional data of the item to the editing server 3,and the processing load required for editing the editing space in theediting terminal 6 can be reduced.

In the virtual reality space editing system 1 according to the firstembodiment, the editing server 3 specifies a spatial area to bedisplayed on the editing screen of the editing terminal 6 or 6A in theediting space as the display target area, and transmitsthree-dimensional data of the display target area among the editingspace information to the editing terminal 6 or 6A. The editing terminal6 or 6A does not need to store the entire editing space information inthe storage device or to process the entire editing space information,and can reduce the load required for editing the editing space in theediting terminal 6 and the load on the storage unit 65.

The program according to the first embodiment is a program for causing acomputer to function as the editing terminal 6 or 6A. In one or moreaspects of the disclosed subject matter, the functionality of theelements disclosed herein may be implemented using circuitry orprocessing circuitry which includes general purpose processors, specialpurpose processors, integrated circuits, ASICs (“Application SpecificIntegrated Circuits”), conventional circuitry and/or combinationsthereof which are configured or programmed to perform the disclosedfunctionality. Processors are considered processing circuitry orcircuitry as they include transistors and other circuitry therein. Theprocessor may be a programmed processor which executes a program storedin a memory. In the disclosure, the circuitry, units, or means arehardware that carry out or are programmed to perform the recitedfunctionality. The hardware may be any hardware disclosed herein orotherwise known which is programmed or configured to carry out therecited functionality. When the hardware is a processor which may beconsidered a type of circuitry, the circuitry, means, or units are acombination of hardware and software, the software being used toconfigure the hardware and/or processor. By the processor of thecomputer executing the program, the editing terminal 6 or 6A capable ofreducing the load required for editing the editing space is achieved.

The virtual reality space editing method according to the firstembodiment includes a step in which the simple display data acquisitionunit 621 acquires the simple display data from the item managementserver 2 that has the three-dimensional data of each of the plurality ofitems and the simple display data and manages the plurality of items, astep in which the item selection processing unit 622 receives selectionof an item from the plurality of items displayed using the simpledisplay data, a step in which the three-dimensional data acquisitionunit 623 acquires the three-dimensional data of the selected item fromthe item management server 2, and a step in which the editing processingunit 624 displays the editing space on the editing screen on the basisof the editing space information, receives input of the operationinformation of the selected item, transmits the operation information tothe editing server 3, and displays the editing space after editing onthe editing screen. While a plurality of selectable items can bedisplayed, it is not necessary to acquire the three-dimensional data ofall of the plurality of items in advance, and thus the editing terminal6 or 6A can reduce the load required for editing the virtual realityspace.

Second Embodiment

FIG. 10 is a block diagram illustrating a configuration of a virtualreality space editing system 1A according to a second embodiment. InFIG. 10 , the virtual reality space editing system 1A is a system inwhich the item management server 2, an editing server 3A, the serviceproviding server 4, the item providing terminal 5, an editing terminal6-1, an editing terminal 6-2, and the participation terminal 7 areconnected via the network 8. Furthermore, the editing terminals 6-1 and6-2 are different first terminal devices from each other used bydifferent editors from each other to edit the same editing space. Notethat, here, a case where there are two editing terminals 6-1 and 6-2 asthe first terminal device, but there may be three or more first terminaldevices that edit the same editing space. Hereinafter, with respect toan editor who edits the editing space using one first terminal deviceamong the plurality of first terminal devices, an editor who edits theediting space using another first terminal device may be referred to asan “cooperative editor”. For example, the editor who uses the editingterminal 6-2 is a cooperative editor of the editor who uses the editingterminal 6-1, and the editor who uses the editing terminal 6-1 is acooperative editor of the editor who uses the editing terminal 6-2.Furthermore, hereinafter, all the editors who use the plurality of firstterminal devices to edit the same editing space may be collectivelyreferred to as “cooperative editors”.

The item providing terminal 5, the editing terminal 6-1, the editingterminal 6-2, and the participation terminal 7 are terminal devicescapable of communicating with the item management server 2, the editingserver 3A, or the service providing server 4 via the network 8, and are,for example, smartphones, tablet terminals, or PCs. In addition, theediting terminal 6-1, the editing terminal 6-2, and the participationterminal 7 may be the head mounted display and the controller describedin the first embodiment.

Upon acquiring the operation information regarding the editing operationof the editing space information from one or both of the editingterminals 6-1 and 6-2, the editing server 3A acquires thethree-dimensional data of the item indicated by the operationinformation from the item management server 2 via the network 8. Theediting server 3A edits the editing space information in such a mannerthat the item is arranged in the editing space at the position and thedirection indicated by the operation information by using thethree-dimensional data of the item. The virtual reality space editingsystem 1A is used for editing (hereinafter referred to as “cooperativeediting”) the same editing space using the editing terminals 6-1 and6-2.

For example, when an editor who is a user of the editing terminal 6-1 isa person in charge of editing the editing space, and the person incharge selects the user of the editing terminal 6-2 as a partner to be acooperative editor, the person in charge transmits access information tothe editing terminal 6-2 to the editing server 3A using the editingterminal 6-1. The editing server 3A manages respective pieces of theaccess information of the editing terminal 6-1 and the editing terminal6-2 in association with each other, and sets the editing space as theediting target in the editing terminal 6-1 as the editing target of theediting terminal 6-2. Note that, as a method of selecting the partner tobe the cooperative editor and setting and managing the accessinformation, any method can be employed within a range in whichcooperative editing with only an intended partner is possible.

The editing server 3A specifies the same editing space as the editingtarget of the editing terminals 6-1 and 6-2 on the basis of the editingspace information indicating the editing space as the editing target inthe editing terminal 6-1 and the editing space information indicatingthe editing space as the editing target in the editing terminal 6-2. Theediting server 3A edits the editing space on the basis of the operationinformation acquired from each of the editing terminals 6-1 and 6-2.Thus, the respective editors of the editing terminals 6-1 and 6-2 cancooperatively edit the same editing space.

In a case where the same editing space is being displayed on the editingscreen of each of the editing terminals 6-1 and 6-2, the editing server3A transmits the editing space information after editing to all of theediting terminals 6-1 and 6-2. For example, in a case where the editingterminals 6-1 and 6-2 set the same editing space as the editing target,when an editing operation of the editing space is performed using any ofthe editing terminals, the editing server 3A transmits the operationinformation regarding the editing operation to the editing server 3A,and transmits the editing space information after the editing server 3Aperforms editing on the basis of the operation information to all of theediting terminals 6-1 and 6-2 via the network 8. The editing terminals6-1 and 6-2 display the editing space after editing on the editingscreen on the basis of the editing space information received from theediting server 3A. Thus, the editing terminals 6-1 and 6-2 can share theediting content of the editing space.

The editing server 3A stores the editing space information in which theediting terminals 6-1 and 6-2 are associated with display target areason the editing screens of the editing terminals 6-1 and 6-2 in theediting space. The display target area is a spatial area being displayedon the editing screen of each of the editing terminals 6-1 and 6-2. Theediting server 3A restricts redundant editing of the editing space bythe editing terminals 6-1 and 6-2 on the basis of the editing spaceinformation.

For example, at the time of editing a part of the display target area onthe basis of the operation information acquired from the editingterminal 6-1, in a case where the editing target based on the operationinformation acquired from the editing terminal 6-2 is the same part inthe display target area, the editing server 3A does not receive editingby the editing terminal 6-2 on this part. Moreover, at the time ofediting a part of the display target area on the basis of the operationinformation acquired from the editing terminal 6-1, the editing server3A may edit the editing space information so that an area correspondingto this part on the editing screen of the editing terminal 6-2 becomes anon-editable area, and transmit the edited space information to theediting terminal 6-2. Thus, the editing server 3A can restrict redundantediting of the editing space by the editing terminals 6-1 and 6-2.

The editing terminal 6-1 displays the display target area of the editingterminal 6-2 in a distinguished manner from areas other than the displaytarget area on the basis of the editing space information. Furthermore,the editing terminal 6-2 displays the display target area of the editingterminal 6-1 in a distinguished manner from the areas other than thedisplay target area on the basis of the editing space information. Forexample, the editing terminal 6-1 displays an area corresponding to thedisplay area of the editing terminal 6-2 in the display target area onthe editing screen in a distinguished manner from other areas. Examplesof a method of distinguishing display include displaying the areas indifferent colors from each other, displaying the area of the cooperativeediting partner in a blinking manner, and displaying a frame line alongthe outer shape of the area of the cooperative editing partner. Thus,the cooperative editor can easily distinguish the areas of the editingspaces being edited by each other on the editing screen.

The editing server 3A specifies, as the display target area, a spatialarea of the editing space in which each of the editing terminals 6-1 and6-2 is displayed on the editing screen, and transmits three-dimensionaldata of the display target area among the editing space information toeach of the editing terminals 6-1 and 6-2. Thus, since the editingterminals 6-1 and 6-2 are only required to acquire the editing spaceinformation indicating each display target area instead of the entireediting space information from the editing server 3A, it is notnecessary to store the entire editing space information in the storagedevice or to process the entire editing space information, and theprocessing load required for editing the editing space and the load ofthe storage unit can be reduced.

The editing server 3A leaves an editing history for each editor whoedits the editing space using the editing terminals 6-1 and 6-2. Forexample, in the same editing space, in a case where a first editorperforms editing related to the first item using the editing terminal6-1 and a second editor performs editing related to the second itemusing the editing terminal 6-2, the editing server 3A stores the editingspace information after editing related to the first item in associationwith the first editor, and stores the editing space information afterediting related to the second item in association with the secondeditor.

The editing terminal 6-1 displays the editing space after editingrelated to the first item and the second item on the editing screen onthe basis of the editing space information received from the editingserver 3A and associated with each of the first editor and the secondeditor. Similarly, the editing terminal 6-2 displays the editing spaceafter editing related to the second item and the first item on theediting screen on the basis of the editing space information receivedfrom the editing server 3A. By using the editing history, it is possibleto display the editing content for each editor on the editing screen inthe cooperative editing of the editing space. Furthermore, by leavingthe editing history for each editor, in a case where any editor desiresto cancel editing performed by himself or herself, it is possible toeasily cancel the editing without affecting the editing performed byother editors.

FIG. 11 is a block diagram illustrating a configuration of the editingterminals 6-1 and 6-2. In FIG. 11 , the editing terminals 6-1 and 6-2include the communication unit 61, a calculation unit 62B, the displayunit 63, the operation unit 64, and the storage unit 65. The calculationunit 62B includes the simple display data acquisition unit 621, the itemselection processing unit 622, the three-dimensional data acquisitionunit 623, and an editing processing unit 624B. For example, thecalculation unit 62B executes the editing application stored in thestorage unit 65, thereby implementing the functions of the simpledisplay data acquisition unit 621, the item selection processing unit622, the three-dimensional data acquisition unit 623, and the editingprocessing unit 624B.

The editing processing unit 624B of the editing terminal 6-1 displaysthe editing space edited by the editing terminal 6-2 in synchronizationwith generation of the operation information in the editing terminal 6-2on the basis of the editing space information. Furthermore, the editingprocessing unit 624B of the editing terminal 6-2 displays the editingspace edited by the editing terminal 6-1 in synchronization with thegeneration of the operation information in the editing terminal 6-2 onthe basis of the editing space information. For example, the editingterminal 6-2 receives an input of operation information regarding theediting operation of the editing space, and transmits the receivedoperation information to the editing server 3A. The editing server 3Aedits the editing space on the basis of the operation information fromthe editing terminal 6-2, and transmits the editing space informationafter editing to the editing terminal 6-1. The editing terminal 6-1displays the editing space edited on the basis of the operationinformation of the editing terminal 6-2. Thus, the editing terminals 6-1and 6-2 can cooperatively edit the editing space.

FIG. 12 is a flowchart illustrating a virtual reality space editingmethod according to the second embodiment, and illustrates cooperativeediting by the editing terminals 6-1 and 6-2 illustrated in FIG. 10 .

In the editing terminals 6-1 and 6-2, the simple display dataacquisition unit 621 causes the communication unit 61 to acquire thesimple display data from the item management server 2 via the network 8(step ST1A).

The item selection processing unit 622 receives selection of an itemfrom a plurality of items displayed using the simple display data (stepST2A).

The three-dimensional data acquisition unit 623 acquires thethree-dimensional data of the item selected by the item selectionprocessing unit 622 from the item management server 2 via the network 8by the communication unit 61 (step ST3A).

The editing processing unit 624A displays the editing screen on thebasis of the editing space information, and receives an input of theoperation information of the item selected by the item selectionprocessing unit 622. In the editing terminals 6-1 and 6-2, the editingprocessing unit 624A causes the communication unit 61 to transmit thereceived operation information to the editing server 3A via the network8, and displays the editing space after cooperative editing on theediting screen (step ST4A).

FIG. 13 is a screen diagram illustrating the editing screen 63A incooperative editing, and illustrates the editing screen 63A of theediting terminal 6-1 that performs cooperative editing with the editingterminal 6-2. An avatar 635A is an avatar corresponding to the firsteditor who uses the editing terminal 6-1, and an avatar 635B is anavatar corresponding to the second editor who uses the editing terminal6-2. As illustrated in FIG. 13 , in addition to the avatar 635Bcorresponding to the second editor, the editing processing unit 624Bincluded in the editing terminal 6-2 can display the avatar 635Acorresponding to the first editor who is a cooperative editor on theediting screen 63A. Similarly, in addition to the avatar 635Acorresponding to the first editor, the editing processing unit 624Bincluded in the editing terminal 6-1 can display the avatar 635Bcorresponding to the second editor who is a cooperative editor on theediting screen 63A.

The editing processing unit 624B of the editing terminal 6-1 transmits,to the editing server 3A, the position information of the avatar 635Afor enabling the avatar 635A corresponding to the first editor to bedisplayed in the editing space displayed on the editing screen of theediting terminal 6-2. Furthermore, the editing processing unit 624B ofthe editing terminal 6-2 transmits, to the editing server 3A, theposition information of the avatar 635B for enabling the avatar 635Bcorresponding to the second editor to be displayed in the editing spacedisplayed on the editing screen of the editing terminal 6-1.

For example, the editing terminal 6-1 transmits information (hereinafterreferred to as “avatar information”) indicating the three-dimensionaldata, the position, the direction, and the action of the avatar 635A inthe editing space to the editing server 3A, and the editing server 3Atransmits the avatar information of the avatar 635A to the editingterminal 6-2. Furthermore, the editing terminal 6-2 transmits the avatarinformation of the avatar 635B in the editing space to the editingserver 3A, and the editing server 3A transmits the avatar information ofthe avatar 635B to the editing terminal 6-1. The editing terminals 6-1and 6-2 display the avatars 635B and 635A in the editing space displayedon the editing screen on the basis of the avatar information of theavatar 635B and the avatar information of the avatar 635A acquiredrespectively. Note that, here, a case where there are two editingterminals 6-1 and 6-2 is illustrated, but in a case where there arethree or more editing terminals, the avatar information transmitted fromone editing terminal to the editing server 3A is transmitted from theediting server 3A to all the remaining editing terminals, and eachediting terminal displays the avatars of the cooperative editors.Furthermore, when transmitting the avatar information from anotherediting terminal to each editing terminal, by adding an identifierunique to each editing terminal, the editing server 3A can cause eachediting terminal to recognize from which editing terminal the avatarinformation has been transmitted.

In addition, for example, the editing server 3A may edit the editingspace information so that the avatars 635A and 635B are included in theediting space on the basis of the received avatar information acquiredfrom the editing terminals 6-1 and 6-2, and transmit the editing spaceinformation after editing to the editing terminals 6-1 and 6-2. Theediting terminals 6-1 and 6-2 display the editing space including theavatars 635A and 635B on the editing screen on the basis of the editingspace information after editing acquired from the editing server 3A.

Note that the editing processing unit 624B of the editing terminal 6-1(or 6-2) is only required to transmit the three-dimensional data of theavatar 635A (or 635B) to the editing terminal 6-2 (or 6-1) via theediting server 3A, for example, only when the first editor (or secondeditor) starts the editing application and participates in the editingspace as the avatar 635A (or 635B), or only when the appearance of theavatar 635A (or 635B) is changed, and does not need to continuetransmission at all times. In addition, for example, thethree-dimensional data of the avatar 635A (or 635B) may be included inthe editing server 3A in advance as a default. Furthermore, for example,each editor is only required to be able to recognize the position of theavatar of the cooperative editor, and the direction and the action arenot essential. Therefore, the avatar information is only required tohave at least the position information. In addition, the frequency oftransmission and reception of each avatar information may increase ordecrease according to, for example, a moving speed of each avatar or anetwork environment between the editing terminal and the editing server3A, or may be a constant cycle.

As described above, the editing processing unit 624B of the editingterminal 6-1 (or 6-2) enables the avatar 635B of the second editor (orthe avatar 635A of the first editor) to be displayed in the editingspace, so that the first editor and the second editor who arecooperative editors can know the positions of each other in the editingspace through the avatars 635A and 635B on the editing screen, and thusthe editing terminal 6-1 (or 6-2) can give the editor a real feeling ofperforming cooperative editing. Furthermore, since the first editor andthe second editor can check the respective editing positions by mutuallychecking the positions of the avatars 635A and 635B on the editingscreen, the editing terminal 6-1 (or 6-2) can suppress redundantediting.

Further, the editing processing unit 624B of the editing terminals 6-1and 6-2 can transmit the communication data input from the editor usingeach editing terminal to the editing server 3A via the network 8 by thecommunication unit 61. Then, the editing processing unit 624B of theediting terminal 6-1 (or 6-2) acquires the communication data input bythe second editor from the editing terminal 6-2 (or input by the firsteditor from the editing terminal 6-1) via the editing server 3A, anddisplays the communication data on the editing screen 63A in associationwith the avatar 635B (or 635B). The communication data is dataindicating communication including a chat, an emotion display, a voice,and the like performed between the avatars corresponding to thecooperative editors. The emotion display is a display indicating aplurality of actions and the like prepared in advance as options forconveying the current feeling and the like, and includes a display ofhand clapping, a display of an exclamation mark, a display indicating anaction of producing a whistling sound, and the like.

For example, on the editing screen 63A, the avatar 635A displays handclapping 637A as the emotion display for the editing performed by theavatar 635B. Furthermore, the avatar 635B is talking with the avatar635A through a chat 637B. In this way, by the cooperative editorcommunicating through the avatar, it is possible to give the editor thereal feeling of performing cooperative editing.

The editing terminal 6-1 displays the display target area of the editingterminal 6-2 in a distinguished manner from areas other than the displaytarget area on the basis of the editing space information. Furthermore,the editing terminal 6-2 displays the display target area of the editingterminal 6-1 in a distinguished manner from the areas other than thedisplay target area on the basis of the editing space information. Forexample, on the editing screen 63A, the editing processing unit 624Bincluded in the editing terminal 6-1 displays an editing area 636C,which is a display target area in the editing terminal 6-2, in a colordifferent from that of an editing area 636D other than the displaytarget area on the basis of the editing space information. Thecooperative editor can easily visually recognize the area of the editingspace edited by himself or herself and the area edited by thecooperative editing partner on the editing screen.

FIG. 14 is a block diagram illustrating configurations of editingterminals 6A-1 and 6A-2 which are modification examples of the editingterminals 6-1 and 6-2. In FIG. 14 , the editing terminals 6A-1 and 6A-2include the communication unit 61, a calculation unit 62C, the displayunit 63, the operation unit 64, and the storage unit 65. Furthermore,the calculation unit 62C includes the simple display data acquisitionunit 621, the item selection processing unit 622, the three-dimensionaldata acquisition unit 623, an editing processing unit 624C, and anapproval reception unit 627. For example, when the calculation unit 62Cexecutes the editing application stored in the storage unit 65, thefunctions of the simple display data acquisition unit 621, the itemselection processing unit 622, the three-dimensional data acquisitionunit 623, the editing processing unit 624C, and the approval receptionunit 627 are achieved.

The approval reception unit 627 receives an operation to approve ordisapprove use of editing content edited by another terminal device forcorrection of the participation space information. Examples of approvalor disapproval operation include an operation using the operation unit64 or the like on a button image indicating approval or disapprovaldisplayed on the editing screen.

For example, in a case where the editing terminals 6A-1 and 6A-2 performcooperative editing, the editing processing unit 624C included in theediting terminal 6A-1 receives an input of operation informationregarding an editing operation of the editing space, and transmits theoperation information to the editing server 3A. The editing server 3Aedits the editing space on the basis of the operation informationreceived from the editing terminal 6A-1, and transmits, to the editingterminals 6A-1 and 6A-2, the editing space information indicating thatuse of the editing content for correction of the participation space isnot approved.

In a case where the editing content based on the operation informationreceived by the editing terminal 6A-1 is unapproved, the editingprocessing unit 624C included in the editing terminal 6A-2 displays theediting content on the editing screen so as to allow recognizing thatthe editing content is unapproved can be recognized on the basis of theediting space information.

FIG. 15 is a schematic diagram illustrating an outline of thecooperative editing processing in a case where editing is approved. Adiagram on the left side with an outlined arrow in FIG. 15 being aboundary illustrates a case where the avatar 635A corresponding to theeditor of the editing terminal 6A-1 arranges the item 636 in the editingspace. In the left diagram of FIG. 15 , use of the editing content forcorrection of the participation space information is not approved by theeditor of the editing terminal 6A-1. Thus, as illustrated in the leftdiagram of FIG. 15 , on the editing screen of the editing terminal 6A-1,the item 636 is displayed as a translucent image 636E indicatingnon-approval.

The display mode of the editing content on the editing screen is set tobe changed according to whether use of the editing space information forcorrection of the participation space information is approved ordisapproved. For example, a diagram on the right side with the outlinedarrow in FIG. 15 being a boundary illustrates a display mode of theediting content approved to be used for correction of the participationspace information. When the approval reception unit 627 included in theediting terminal 6A-1 receives an operation of approving use of theediting content in which the item 636 is arranged for correction of theparticipation space information, information indicating approval isoutput to the editing processing unit 624C.

When acquiring the information indicating approval, the editingprocessing unit 624C returns the item 636 to normal display so that thetranslucent image 636E is substantiated on the basis of the editingspace information as illustrated in the right diagram of FIG. 15 . Thus,the editing content of arranging the item 636 is used at the time ofcorrecting the participation space, and the item 636 is arranged in theparticipation space. Since the editing terminals 6A-1 and 6A-2 includethe approval reception unit 627, editing can be performed while mutualapproval is obtained between the cooperative editors. In addition, onlysome of the cooperative editors may be allowed to give approval. Forexample, in a case where only the editor who uses the editing terminal6A-1 can perform approval among two cooperative editors who use theediting terminals 6A-1 and 6A-2, only the editing terminal 6A-1 needs toinclude the approval reception unit 627. In this case, the editing basedon the editing operation using the editing terminal 6A-1 is always usedto correct the participation space.

Note that in a case where the approval reception unit 627 receives anoperation of disapproving the editing content of arranging the item 636,the editing content may be invalidated. For example, in a case where theapproval reception unit 627 included in the editing terminal 6A-1receives an operation of disapproving use of the editing content inwhich the item 636 is arranged for correction of the participation spaceinformation, information indicating disapproval is output to the editingprocessing unit 624C. The editing processing unit 624C transmitsinformation indicating disapproval to the editing server 3A via thenetwork 8 by the communication unit 61. When receiving the informationindicating disapproval, the editing server 3A edits the editing spaceinformation so that the editing content in which the item 636 isarranged is invalidated, and transmits the editing space informationafter editing to the editing terminals 6A-1 and 6A-2. Thus, the editingcontent in which the item 636 is arranged is invalidated in the editingterminals 6A-1 and 6A-2.

FIG. 16 is a block diagram illustrating configurations of editingterminals 6B-1 and 6B-2 which are modification examples of the editingterminals 6-1 and 6-2. In FIG. 16 , the editing terminals 6B-1 and 6B-2include the communication unit 61, a calculation unit 62D, the displayunit 63, the operation unit 64, and the storage unit 65. Furthermore,the calculation unit 62D includes the simple display data acquisitionunit 621, the item selection processing unit 622, the three-dimensionaldata acquisition unit 623, an editing processing unit 624D, and aswitching operation reception unit 628. For example, the calculationunit 62D executes the editing application stored in the storage unit 65,thereby implementing the functions of the simple display dataacquisition unit 621, the item selection processing unit 622, thethree-dimensional data acquisition unit 623, the editing processing unit624D, and the switching operation reception unit 628.

The switching operation reception unit 628 receives a switchingoperation for switching between an avatar viewpoint that is a viewpointof viewing the editing space from the avatar and an editing viewpointfor displaying the editing space different from the avatar viewpoint onthe editing screen. The editing viewpoint is, for example, a viewpointof overlooking the editing space including the avatar. In thecooperative editing using the editing terminals 6B-1 and 6B-2, forexample, each editing processing unit 624D uses the editing spaceinformation acquired from the editing server 3 to create the editingspace information for causing a switch button image for switchingbetween the avatar viewpoint and the editing viewpoint to be displayedon the editing screen. The editing terminals 6B-1 and 6B-2 display onthe editing screen including the switch button image on the basis of theediting space information.

The editor uses the operation unit 64 such as a touch panel to operatethe switch button image displayed on the editing screen. Upon receivingthe operation of the switch button image, the switching operationreception unit 628 outputs information indicating the switchingoperation to the editing processing unit 624D. For example, when theswitching operation reception unit 628 included in the editing terminal6B-1 receives a switching operation for switching the editing space tothe avatar viewpoint, the editing processing unit 624D causes thecommunication unit 61 to transmit information indicating the avatarviewpoint to the editing server 3A via the network 8. Upon receiving theinformation indicating the avatar viewpoint, the editing server 3A editsthe editing space information for displaying the editing space at theavatar viewpoint on the basis of the avatar information indicating theposition and movement of the avatar 635A in the editing space, andtransmits the editing space information after editing to the editingterminal 6B-1. The editing terminal 6B-1 displays the editing space ofthe avatar viewpoint on the editing screen on the basis of the editingspace information received from the editing server 3A.

FIG. 17 is a screen view illustrating an editing screen 63B of theavatar viewpoint in cooperative editing, and illustrates the editingscreen 63B in the editing terminal 6B-1 that performs cooperativeediting with the editing terminal 6B-2. In FIG. 17 , the avatar 635Bcorresponding to the second editor using the editing terminal 6B-2performs the action of carrying an item 636F in the editing space, andthe avatar 635A corresponding to the first editor using the editingterminal 6B-1 performs the action of carrying an item 636G. On theediting screen 63B, the editing space is displayed from the viewpoint ofthe avatar 635B. By displaying the editing space from the avatarviewpoint, it is possible to give the editor corresponding to the avatara realistic feeling in editing the virtual reality space. This isparticularly effective in a case where the editing terminals 6B-1 and6B-2 are head mounted displays.

In a case where the switching operation reception unit 628 included inthe editing terminal 6B-2 receives the switching operation for switchingthe editing space to the editing viewpoint, the editing processing unit624D causes the communication unit 61 to transmit informationinstructing the editing viewpoint to the editing server 3A via thenetwork 8. Upon receiving the information instructing the editingviewpoint, the editing server 3A edits the editing space information fordisplaying the editing space at the editing viewpoint on the basis ofthe avatar information indicating the position and movement of theavatar 635B in the editing space, and transmits the editing spaceinformation after editing to the editing terminal 6B-2. The editingterminal 6B-2 displays the editing space of the editing viewpoint on theediting screen on the basis of the editing space information receivedfrom the editing server 3A.

FIG. 18 is a screen view illustrating an editing screen 63C of theediting viewpoint in the cooperative editing, and illustrates a casewhere the editing screen 63B illustrated in FIG. 17 is switched to theediting screen 63C of the editing viewpoint. In FIG. 18 , the editingviewpoint is a viewpoint looking down on the editing space including theavatars 635A and 635B. On the editing screen 63C, an editing spaceviewed from the editing viewpoint appropriately set in the editingterminal 6B-2 is displayed. By displaying the editing space from theediting viewpoint in this manner, the editor can grasp the entire imageof editing of the virtual reality space.

Note that the virtual reality space editing system 1A can perform notonly cooperative editing using two editing terminals such as the editingterminals 6-1 and 6-2, the editing terminals 6A-1 and 6A-2, or theediting terminals 6B-1 and 6B-2, but also cooperative editing usingthree or more editing terminals.

As described above, in the editing terminal 6-1 (or 6-2) according tothe second embodiment, the editing processing unit 624A displays theediting space edited by the editing terminal 6-2 (or 6-1) on the basisof the editing space information in synchronization with the generationof the operation information in the editing terminal 6-2 (or 6-1). Thus,the editing terminals 6-1 and 6-2 can cooperatively edit the editingspace.

The editing terminal 6A-1 (or 6A-2) according to the second embodimentincludes the approval reception unit 627 that receives an operation ofapproving or disapproving use of the editing content edited by theediting terminal 6A-2 (or 6A-1) for correction of the participationspace information that is the three-dimensional data of theparticipation space that is the virtual reality space in which the userother than the editor is allowed to participate. Thus, editing can beperformed while obtaining approval between the cooperative editors.

In the editing terminal 6-1 (or 6-2) according to the second embodiment,the editing processing unit 624B can display the avatar 635B of thesecond editor (or the avatar 635A of the first editor) in the editingspace. Thus, the cooperative editor can know the positions of each otherin the editing space through the avatars 635A and 635B on the editingscreen, and thus the editing terminal 6-1 (or 6-2) can give the editorthe real feeling of performing cooperative editing. Furthermore, thecooperative editor can check the respective editing positions bychecking the positions of the avatars 635A and 635B on the editingscreen with each other, and thus it is possible to suppress redundantediting.

In the editing terminal 6-1 (or 6-2) according to the second embodiment,the editing processing unit 624B acquires the communication data inputby the second editor from the editing terminal 6-2 (or input by thefirst editor from the editing terminal 6-1) via the editing server 3A,and displays the communication data on the editing screen in associationwith the avatar 635B of the second editor (or the avatar 635A of thefirst editor). As the cooperative editor communicates through theavatar, it is possible to give the editor the real feeling of performingcooperative editing.

The editing processing unit 624C of the editing terminal 6B-1 (and 6B-2)according to the second embodiment is capable of displaying the avatarof the editor in the editing space, and includes the switching operationreception unit 628 that receives a switching operation for switchingbetween the avatar viewpoint that is a viewpoint of viewing the editingspace from the avatar of the editor and the editing viewpoint fordisplaying the editing space different from the avatar viewpoint on theediting screen. When the switching operation reception unit 628 receivesthe switching operation, the editing processing unit 624C switches theavatar viewpoint and the editing viewpoint. By displaying the editingspace from the avatar viewpoint, it is possible to give the editorcorresponding to the avatar a realistic feeling in editing the virtualreality space. Furthermore, by displaying the editing space from theediting viewpoint, the editor can grasp the entire image of editing ofthe virtual reality space.

In the virtual reality space editing system 1A according to the secondembodiment, the editing server 3A edits the editing space on the basisof the operation information acquired from each of the editing terminals6-1 and 6-2 displaying the same editing space on the editing screen.Thus, the respective editors of the editing terminals 6-1 and 6-2 canedit the editing space while displaying the same editing space on theediting screen.

In the virtual reality space editing system 1A according to the secondembodiment, the editing server 3A transmits the editing spaceinformation indicating the editing space after editing to all of theediting terminals 6-1 and 6-2. By displaying the editing space afterediting on the editing screen on the basis of the editing spaceinformation after editing, the editing terminals 6-1 and 6-2 can sharethe editing content of the editing space.

In the virtual reality space editing system 1A according to the secondembodiment, the editing server 3A stores the editing space informationassociated with the editing terminals 6-1 and 6-2 and a display targetarea, which is a spatial area being displayed on the respective editingscreens of the editing terminals 6-1 and 6-2 in the editing space, andrestricts redundant editing of the editing space by the editingterminals 6-1 and 6-2 on the basis of the editing space information. Theediting terminal 6-1 (or 6-2) distinguishes and displays the displaytarget area of the editing terminal 6-2 (or 6-1) from the areas otherthan the display target area on the basis of the editing spaceinformation. Thus, the editing server 3A can restrict redundant editingof the editing space by the editing terminals 6-1 and 6-2. Furthermore,the cooperative editor can easily distinguish the areas of the editingspaces being edited by each other on the editing screen.

In the virtual reality space editing system 1A according to the secondembodiment, the editing server 3A specifies a spatial area to bedisplayed on the editing screen by the editing terminals 6-1 and 6-2 inthe editing space as the display target area, and transmitsthree-dimensional data of the display target area among the editingspace information to the respective editing terminals 6-1 and 6-2. Sincethe editing terminals 6-1 and 6-2 are only required to acquire theediting space information indicating each display target area instead ofthe entire editing space information from the editing server 3A, it isnot necessary to store the entire editing space information in thestorage device or to process the entire editing space information, andit is possible to reduce the load required for editing the editing spaceand the load on the storage unit.

In the virtual reality space editing system 1A according to the secondembodiment, the editing server 3A leaves an editing history for eacheditor who edits the editing space using the editing terminals 6-1 and6-2. By using the editing history, it is possible to display the editingcontent for each editor on the editing screen in the cooperative editingof the editing space. Furthermore, by leaving the editing history foreach editor, in a case where any editor desires to cancel editingperformed by himself or herself, it is possible to easily cancel theediting without affecting the editing performed by other editors.

Note that combinations of the respective embodiments, modifications ofany components of the respective embodiments, or omissions of anycomponents in the respective embodiments are possible.

What is claimed is:
 1. A terminal device, comprising: processingcircuitry configured to acquire display data from an item managementserver that has three-dimensional data and the display data associatedwith each of a plurality of items usable for editing an editing spacethat is a virtual reality space for editing, acquire thethree-dimensional data for predetermined items of the plurality of itemsin advance, wherein the predetermined items acquired in advance areitems that have a predetermined frequency of use, receive selection ofthe items from the plurality of items displayed using the display dataon an editing screen displayed for editing the editing space, inresponse to receiving selection of an item from the plurality of itemsthat has not had the three-dimensional data acquired in advance, acquirethree-dimensional data of the selected item from the item managementserver, display the editing space on the editing screen based on editingspace information that is three-dimensional data of the editing space;receive an input of operation information regarding an editing operationof the editing space using the three-dimensional data of the selecteditem; transmit the operation information to an editing server thatmanages the editing space; and display the editing space after editingon the editing screen.
 2. The terminal device according to claim 1,wherein the processing circuitry is further configured to acquire, asthe editing space information from the editing server, three-dimensionaldata of a display target area that is a spatial area displayed on theediting screen among the editing space information of the editing spacemanaged by the editing server, and display the display target area onthe editing screen.
 3. The terminal device according to claim 1, whereinthe plurality of items includes items having a same shape as each otherand different characteristics indicating colors or virtual materials, aplurality of background items related to different backgrounds from eachother that are three-dimensional data of a background of the editingspace, and a tool item that is a tool for space editing.
 4. The terminaldevice according to claim 1, wherein the processing circuitry is furtherconfigured to transmit, to the editing server, a correction instructionfor correcting, based on the editing space information included in theediting server for managing the editing space, participation spaceinformation that is three-dimensional data of a participation space thatis a virtual reality space in which a user other than an editor isallowed to participate.
 5. The terminal device according to claim 1,wherein the processing circuitry is further configured to cause theediting space to be displayed based on the editing space information,and cause the participation space to be displayed based on participationspace information that is three-dimensional data of a participationspace that is a virtual reality space in which a user other than aneditor is allowed to participate.
 6. The terminal device according toclaim 5, wherein the processing circuitry is further configured toswitch and display the editing space and the participation space.
 7. Theterminal device according to claim 5, wherein the processing circuitryis further configured to display editing content already used forcorrection of the participation space and editing content not yet usedfor correction of the participation space in the editing space in adistinguished manner.
 8. The terminal device according to claim 1,wherein the processing circuitry is further configured to display theediting space edited by another terminal device in synchronization withgeneration of the operation information in the other terminal devicebased on the editing space information.
 9. The terminal device accordingto claim 8, wherein the processing circuitry is further configured toreceive an operation of approving or disapproving use of editing contentedited by the other terminal device for correction of participationspace information that is three-dimensional data of a participationspace that is a virtual reality space in which a user other than aneditor is allowed to participate.
 10. The terminal device according toclaim 8, wherein the processing circuitry is further configured toenable an avatar of a cooperative editor who is an editor who edits theediting space using the other terminal device to be displayed in theediting space.
 11. The terminal device according to claim 10, whereinthe processing circuitry is further configured to acquire communicationdata input from the other terminal device by the cooperative editor viathe editing server, and display the communication data on the editingscreen in association with the avatar of the cooperative editor.
 12. Avirtual reality space editing system, comprising: an item managementserver; an editing server; and a first terminal device comprisingprocessing circuitry configured to acquire display data from the itemmanagement server that has three-dimensional data and the display dataassociated with each of a plurality of items usable for editing anediting space that is a virtual reality space for editing, acquire thethree-dimensional data for predetermined items of the plurality of itemsin advance, wherein the predetermined items acquired in advance areitems that have a predetermined frequency of use, receive selection ofthe items from the plurality of items displayed using the display dataon an editing screen displayed for editing the editing space, inresponse to receiving selection of an item from the plurality of itemsthat has not had the three-dimensional data acquired in advance, acquirethree-dimensional data of the selected item from the item managementserver, display the editing space on the editing screen based on editingspace information that is three-dimensional data of the editing space;receive an input of operation information regarding an editing operationof the editing space using the three-dimensional data of the selecteditem; transmit the operation information to the editing server thatmanages the editing space; and display the editing space after editingon the editing screen, wherein upon acquiring the operation informationfrom the first terminal device, the editing server acquires thethree-dimensional data of the selected item indicated by the operationinformation from the item management server, and edits the editing spaceinformation included in the editing server in such a manner that theselected item is arranged in the editing space at a position and adirection indicated by the operation information.
 13. The virtualreality space editing system according to claim 12, wherein the itemmanagement server receives upload of the selected item from a secondterminal device that is different from the first terminal device, andmanages the selected item that has been received.
 14. The virtualreality space editing system according to claim 12, wherein the editingserver specifies a spatial area displayed on the editing screen of thefirst terminal device in the editing space as a display target area, andtransmits three-dimensional data of the display target area among theediting space information to the first terminal device.
 15. The virtualreality space editing system according to claim 12, wherein the editingserver edits the editing space based on the operation informationacquired from each of a plurality of terminal devices displaying theediting space that is same as displayed on the editing screen, and theediting server transmits the editing space information, which is thethree-dimensional data of the editing space after editing, to each ofthe plurality of the first terminal devices.
 16. The virtual realityspace editing system according to claim 15, wherein the editing serverstores the editing space information in which each of the plurality ofterminal devices is associated with a display target area that is aspatial area being displayed on the editing screen of each of theplurality of terminal devices in the editing space, and restrictsredundant editing of the editing space by the plurality of terminaldevices based on the editing space information, and the first terminaldevice displays the display target area of another one of the pluralityop terminal devices in a distinguished manner from an area other thanthe display target area of the other one of the plurality of terminaldevices based on the editing space information.
 17. The virtual realityspace editing system according to claim 15, wherein the editing serverspecifies a spatial area to be displayed on the editing screen by eachof the plurality of terminal devices in the editing space as a displaytarget area, and transmits three-dimensional data of the display targetarea among the editing space information to each of the plurality ofterminal devices.
 18. The virtual reality space editing system accordingto claim 15, wherein the editing server leaves an editing history foreach editor who edits the editing space using the first terminal device.19. A non-transitory computer-readable medium storing a program forcausing a computer to function as the terminal device according toclaim
 1. 20. A virtual reality space editing method, comprising:acquiring display data from an item management server that hasthree-dimensional data and the display data associated with each of aplurality of items usable for editing an editing space that is a virtualreality space for editing and manages the plurality of items; receivinga selection of the plurality of items from the plurality of itemsdisplayed using the simple display data on an editing screen displayedfor editing the editing space; in response to receiving selection of anitem from the plurality of items that has not had the three-dimensionaldata acquired in advance, acquiring three-dimensional data of theselected item from the item management server; displaying the editingspace on the editing screen based on editing space information that isthree-dimensional data of the editing space; receiving an input ofoperation information regarding an editing operation of the editingspace using the three-dimensional data of the selected item;transmitting the operation information to an editing server that managesthe editing space; and displaying the editing space after editing on theediting screen.